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The state space for the iV-spin mean field (SK) spin glass — nominally an iV-cube — 
is embedded in a low dimensional continuous space in such a way that metastable and 
stable phases can easily be discerned, a concept of nearness of configurations defined, 
and peaks in the Parisi ^-parameter overlap distribution identified. The dynamical 
and partly hierarchical interrelation of these phases can be directly imaged. 

PACS numbers: 75.10.Nr, 02.50.Ey, 64.60.My, 89.75.Fb 
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The mean field (SK) spin glass [l| continues to be an active focus of research both for 
its own sake and for the light it can cast on the short-range spin glass 0, 0, 0, 0, @, 0]. 
Nevertheless, problems remain. Among these is the difficulty of visualizing its state space. 
One would like to have an idea of the energy landscape, the absolute and local minima, an 
image of what states are "near" those minima and perhaps even get a handle on the elusive 
notion of pure state in finite systems. It would be especially convenient if phases, metastable 
or stable, could be identified and well-localized on this landscape. A geometric picture in 
which at least some of these goals can be achieved is the object of the present article. 

For systems evolving under stochastic dynamics there is an embedding, known as the ob- 
servable representation (si, 0] , of the state space into continuous spaces of various dimension. 
In it the features just mentioned stand out in simple form, with phases identified as the 
extrema of a certain convex set and with a natural distance inherited from the dynamics on 
the system. This provides a direct image of the interrelationship between phases and of the 
hierarchical structure of passage from phase to phase. The notion of metastable phase — 
problematic in infinite volume systems — is completely natural in this context. Finally, there 
is no restriction of our method to the SK model, the only issue being whether lattice models 
exhibit structure for systems small enough for our technique to be applied. 

The observable representation provides an abstract definition of phase (stable and 
metastable) and can be used to see the relation of phases to the Parisi overlap parame- 



ter [10l | . "g." In addition the temporal flow of child phases into parents can be displayed. 
In this article I use as the state space all 2 N configurations and relatively simple matrix 
methods. As I will also show, considerable reduction in the state space is possible, opening 
the door to extensive use of this method. 

I first recall the definition of the observable representation. Then I offer evidence for 
structure in the 12-spin system (those less troubled by state-space size have not looked 
at such small systems). Then I get to the main point, which is to show how structure is 
displayed in the observable representation. I close with a discussion of prospects. 

The observable representation and associated notation. — States are x,y,z e X, with X a 
finite set. The system moves in discrete time according to an (assumed) irreducible stochastic 
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matrix R: R xy = Pr(z(t + 1) = x | z(t) = y). For a spin glass, i? satisfies detailed balance 
(although Refs. jl, [jjj are more general). The eigenvalues of R are therefore real and can 
be written 1 = A > |Ai| > |A 2 | ■ ■ • > 0. A is associated with the stationary distribution: 
Rpo — Po] the eigenvalue relation for the associated left eigenvector, A (x) = 1, expresses 
conservation of probability. Left eigenvectors are designated Ak (same k as in {A^}) and 
right eigenvectors pk- They satisfy (Ak\pj) = Skj and are normalized by max x \ Ak(x)\ = 1. 

The m-dimensional observable representation is the following set (to be thought of as an 
embedding of X in R m ) 

A m = {A G K m | A = (Axix), A m {x)) , x 6 X} . (1) 

To visualize, write the first m left eigenvectors as row vectors, one atop the other. The 
points of A m are then the columns: 

A(xi) A(x 2 ) A(x 3 ) ... 
A 1 -> A l (x 1 ) A x {x 2 ) A x (x z ) ... 

A 2 ^ A 2 (xi) A 2 {x 2 ) A 2 {x 3 ) ... y 2 > 

A m -> A m (xi) A m {x 2 ) A m (x 3 ) . . . 
8| we established the properties of A m when there is a phase transition, which corresponds 
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is not, A m is a simplex with points belonging to the phases located at the vertices. Interior 
points are not in phases, but their barycentric coordinates with respect to the extrema are 
the probabilities that these points evolve towards the corresponding phase. 

In j8| we distinguished which assertions remain true if A m+ i is not small. The convex hull 
of A m need not be a simplex, but there still are extrema, and points dynamically close and in 
a phase cluster about the extrema. The relation between dynamical proximity and closeness 
in A also holds for non-extrema [||. Let D(x,y;t) = J2 U IC^*)«a; — / \/Po(u). (R^ux 

is the probability that starting at x one arrives at u in t time steps. Then D(x, y; t)/\ A m |* > 

[Sa=i — Ai(2/)| 2 ] ^ • Points whose distributions merge are spatially close in A. 

Small mean-field models. — I next show that for N as small as 12 there are structures associ- 
ated with slow relaxation to more stable phases. The energy is E = — J2fk=o JjkO'jO'k/2y/N, 
with Jjk = ±1 the quenched bonds and aj = ±1 the spins. The temperature-T transition 
probability from x = (a%, cr 2 , . . . , o"at) to x' ^ x is R(x', x) = exp [— (E(x') — E(x)) /T] /N 
when E(x') > E(x); otherwise it is 1/N. I permit only single spin flips. 

Structure was observed in the time-dependent distribution of the Parisi overlap param- 
eter, "g" 0, For fixed J, two random initial conditions (x^) are taken. They 
evolve separately under the stochastic dynamics and the overlap q = x^-x^/N = 

(l/N) ^2^=i cr fc 1 ' )cr fc 2 ^ ^ s calculated. Values of q are collected for many times and many ini- 
tial conditions. In the distribution function for q, peaks represent persistence in pairs of 
metastable phases, and the time dependence of the distribution reflects relaxation. 

For N = 12 there is structure. Fig. [T] shows histograms for a specific quench, (to 
be called J), for three run times. For a few hundred time steps the system gets caught 
in metastable phases whose importance gradually lessens (space limitations preclude more 
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FIG. 1: Histogram of the distribution function for u q" for the same quench, for a succession of 
times. T = 0.2 T c and t = 100, 200, and 3000. The central peak does not correspond to an absence 
of ordering. Rather the phases break into pairs, with half the pairwise products, x^' ■ x^ k \ being 
zero. Fig. [lb is close to the infinite-time distribution, y Po(x)po(y)S(q — q xy )- 



figures) until about time 3000. This time scale is confirmed by {A^}. Note that the central 
peak does not indicate an absence of structure (see the caption). 

Visualizing structure in the observable representation. — Figs. [2] and [3] show A2 and A3 
for the R associated with J. The first few eigenvalues of 1 — R are: 0, (2.1, 7.1, 8.3) x 10~ 6 , 
(5.58, 5.62, 11.19, 11.20) x 10" 4 , (7.92, 7.93, 10.84, 10.86) x 10~ 3 . By the criteria of there 
are many phases (although for some J's the eigenvalue dropoff is less steep). 

The following features can be identified. The four "corner" states in A% are absolute 
minima. The clusters of nearby points constitute the ground states, and as in [8| (Fig. 3), 
contain more points than is evident to the eye. The prominent points near A\ = (at large 
I-A2I) support metastable phases (they are extrema in higher dimension), but do not evolve 
to unique target phases. A state at one of these positions will ultimately find itself with 
near 50-50 probability on one side or the other. This statement is not based on simulation 
(although it can be so verified), but rather on the "barycentric" theorem quoted earlier. The 
prominent points near A 2 = (with large \Ai\) have similar properties and asymptotics. 

To study the hierarchy of temporal evolution I use the extrema of A to identify phases. 
For J there are 32 local minima and by A7 they are all extrema. I use them as the nuclei of 
the phases. Among J's this is a relatively large number, but our results are unchanged when 
non-local-minimum-extrema are used as nuclei. A significant aspect of phase identification 



is the positing of a distance on X. We have previously discussed several metrics [12l . Il3 



and I here use df(x,y) = J2k>i \Ak( x ) — Ak(y)\ |Afc|*. t is an adjustable time scale. The 
results are not sensitive to t, to the power of — Ak(y)\, or to which decreasing (as 

k |) function of A& is used. 

Phases can now be denned: For a phase nucleus, x (an extremum in A m for appropriate 
m), the distance to the nearest other nucleus was found. All points within half that distance 
were associated with x and called its phase. This left points in "no man's land," which was 
formally treated as another phase. For J they were about 40% of the points. Nevertheless, 
their total po measure was only ~ 2 x 10 -5 . 

The next step was to study the induced dynamics among the phases. An ensemble of 
points was started within each phase with the probability of being in a given state (within 
that phase) proportional to its po measure I then checked the likelihood that on exiting 
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FIG. 2: A2 for J. Symbol size increases with equilibrium weight (hence lower energy). Circles 
indicate local minima in energy. Note: For reasons that are beyond me, the arXiv refuses to print 
the eps file associated with this figure. Please see the published version of the article. 

this phase it went to a particular other phase [15j • This coarse-grained matrix of transition 
probabilities is designated R. 

It is in a diagrammatic representation of the flows in R that one can hope to see the 
hierarchical structure associated with relaxation through a succession of metastable phases. 
Fig. H] shows two such representations. In the first, the phases are sorted (based on a 
histogram of lifetimes) into 3 categories, long-, medium- and short-lived. On the lowest 
level are the longest- lived, etc. The symbol and color correspond to the amount of inflow. 
A phase's left-right position follows the A\ values of that phase's nucleus among phases at 
the same lifetime level. Lines indicate transition probabilities, with line width a monotonic 
function of transition probability. Blue lines are flow from higher (shorter lifetime) levels 
to lower, red go oppositely, and green represents lateral transitions. A perfect hierarchical 
structure would be almost all blue and each node would flow to only one other node. This is 
clearly not the case, with the principal deviations related to the col-like metastable phases. 

A second display is to superimpose the flows of R on the observable representation for 
R (putting a phase at the location of its nucleus). This is the second image in Fig. @J Now 
the symbol reflects the energy of the nucleus of the phase, and its size the lifetime. Again 
the breakdown in tree structure arises principally from the quasi-cols. The stable phases are 
in the corners, and those metastable phases that have flows to more than one side of the 
diagram are of intermediate lifetime and have A\ near zero. 

If one were to watch the time evolution of the system on this embedding, it would have the 
appearance of a random walk on a landscape of hills and valleys, as envisioned for example 
in Kobe and Krawczyk [l6|, who present images very much resembling ours. The advantage 
of using the observable representation is that I do not need to resort to hamming distance 
(which can be a poor measure of dynamical proximity, but have a metric that is automatic 
and has physical significance. 

The variation of these figures with quench can be seen in Fig. illustrating R for a 13- 
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FIG. 3: .A3 for J. Symbol size increases with equilibrium weight (hence lower energy). Circles 
indicate local minima in energy. The convex hull (a tetrahedron) has been outlined. The vertical 
lines of large-weight points on the left and right sides of A2 are at approximately right angles to 
one another in M 3 . 




FIG. 4: Representations of the matrix R, as explained in the text. The quench is J. The sequence 
of symbols (in order of declining amount) is circle, star, base-up triangle, base-down triangle. The 
sequence of colors is black, red, blue, green, cyan. 

spin system. There are no isolated local minima (there are equal energy pairs differing by a 
spin flip) , nor do the local-minima exhaust the extrema used. Here a more tree-like structure 
occurs. The cols (the most important being the base-down triangles at A\ ~ ±0.45) are 
both of lesser weight and have larger |Ai| values. This also is evident in Fig. [5^, since the 
principal phases that feed both sides have relatively short lifetimes. 

Returning to J, I interpret the transients in Fig. [TJ I have already noted that the central 
peak persists for long times because the product of points in the stable phases is zero for 
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FIG. 5: Representations of the matrix R for a 13 spin system, as explained in the text. The same 
symbols, etc., are used as in the previous figure. 



several combinations. In the time-200 histogram the largest peaks away from or ±1 are 
at q — ±1/3. Aside from combinations of low probability these involve exclusively the two 
phases at (Ai, A%) ~ ±(0.12, 0.72), which are the stars in Fig. H]d (and are extrema of Aq). 
Indeed, going to our lifetime data, there are only 4 phases with lifetimes on the order of 
hundreds. The other two are located at (A 1 ,A 2 ) ~ ±(0.87,0.18) (referred to earlier as 
metastable phases). Their inner product with the stable states however is either or ±1. I 
have thus identified the phases giving rise to a specific peak in the Parisi g-distribution. 

Summary and prospects.— The observable representation for the mean field spin glass 
(and for other systems as well) provides a continuous embedding of a discrete state space. 
In this representation, the distance between points reflects their dynamical proximity and 
the extrema of the convex hull of the set of points correspond to phases, both stable and 
metastable. Moreover, the barycentric coordinates of a point located in the interior of the 
convex hull provide probabilities for the asymptotic arrival of this point in one or another 
of the phases. 

An obstacle to the implementation of this representation is the growth of the state space 
with N, the number of spins. There are two reasons, however, that it should prove possible 
to go well beyond the iV's used in this article. First, my own resources, both with respect to 
programming and hardware are modest. But more important is the possibility of focusing 
on the significant states. This is done, for example, in Ref. 16|], where for the 4x4x4 lattice 
spin glass (2 64 spin configurations) they restrict themselves to the first 3 levels, comprising 
1635796 ~ 2 20 6 states, a reduction of more than 40 powers of 2. To test whether such a 
reduction would affect the observable representation, I restricted the matrix R associated 
with the quench J to the first 4 energy levels. This gave 162 states in place of 4096. The 
associated observable representation is shown in Fig. [6J Comparison with Fig. [2] shows that 
the restriction has left the important information intact. This justifies optimism that the 
3x3x3 cube should yield to this analysis, and perhaps larger systems as well. 
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FIG. 6: Observable representation for the same quench (and the same temperature) as Fig. [2J 
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